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ABSTRACT , % 

The experiences of black and Hispanic students from 
low inccae families who spent their senior year in this program is 
re'portec and evaluated. The Secondary Education Through Health (SETH) 
program was designed to prepare interested inner city high school 
seniors to enter medical and health careers and tc give them an 
understanding of environmental health issues affecting the East 
^Harlem cooaunity. The program provided three types of learning 
settings: lecture or^ recitation classes in academic subjects, 
environmental health' projects in which students functioned as field 
researchers, and job placements in various working units throughout 
the hospital* The overall objective of 'the prograa was to contribute 
to a conceptual scheme and a Methodology for dccuaenticg and 
evaluating qualitatively and quantita tivjely both formal and nonforaal 
aspects of -alternative educational frograms, (Author/MC) 
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ABSTRACT 



Stjadents* Access Language and Perforinance with.. People , Data, 
aria Things in the Formal and Non-Formal Settings of an Alterna- 
tive Jnner-City hign Scljool. 

JOSEPH (J. GRANNIS,- Teachers College, Columbia University 
yiARIAN L. SChWARZ, Teachers College, Columbia University 
ISTAR SCHWAGER, City University of New York 
LLOYD R. SHERMAN, The Mourit Sinai Hospital, New York City 

This ^ paper repoTt^e on a qualitative/quantitative research ^ 
para.aigm designed tor application to ^work-study and/or other 
alternati^^e educatiCTial programs whicn represent combinations 
ot formal and non-formal education. The research' emoloys \. 
social ecology; task analysis, and sociolmguist^s to explore' 
linkages^ between instructional and work settxTigs and to explore 
wnicn setting cnarac^eristics evoke ;}:he .highest levels ot^ 
student functioning with tnings, witn data and ^wit^ people 
and the most use of ''access language'. Findings support tne * 
utili<:y of the oiDservation instrument and tne etficacy of a 
curriculum model that represents an intersection of formal and 
non-formal strategies. 

Introduction * " , * , / 

The proposed paper repdrts pn evaluation research conducted 
for the work stiid^'' program ot an alternative schopl located at 
Mount Sinai hospital in-flew Xork City.' The program, icnown as 
SETH (Secondary i::ducatxon Through Healtn^ , was designed to 
develop m inner city high\ school' seniors entry level academic 



ana work sKilis' for n^edical and neaith careers as well as 
an understanding of environmental heal^n issues affecting 
the .students* own East Harlem community. The proqram provided 
three types of learning settings — lecture — recitfat'^n classes 
m academic subjects, environmental health projects' m which 
students functioned as field researchers, and job placements 
m various working units throughout the hospital. 
Objectives / 

The overall objective ot\the research was to contribute 

to a conceptual scheme and to methodology ror documentiing tne 

quality of both tormal and non-forifial aspects ot alternative 

educational programs. More specif ic 'cbj ectives were: 

*\ 

1. The development of an observation instrument that 

coula apoly equally to instructional andj^^work (formal and non- 
formal educational) settings, an instrument: that could enable 
the observer to make comparisons and establish linkages between 
tnese dif f erent^g^ttirfgs and the student bena^iqrs found m 



tnem. ' "^.X 



2. 'To ascertain levels of student per forltiance witii 
things, data, and people *^^n th^ different settings , .ii\e . , l^els • 
of physical, intellectual ,\aTid social functioning. » ^ ^ 

3. To measure the u^e of 'ac)bess language' — ^talk 

usea to gain or maintain control^' of a situation — in the different 
settings. ^ y-" N 

4. To understand better tne communicative patterns \ 

■ \ 

(codes and registers) required ot participants in various job ^ 
settings and ways in which tnese patterns vary from tnose 
required m school settings . 
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5/ ^ To identity conditions that are associated 
with higher ievei performances across settings — the assumption 
being that student enactment of higher levels of physicai, * ^ 
intellectual and social funct:^oning and their more extensive 
use of access /language maximizes the learning that is taking 
place. 

Pers]6ectives » . ' - 

The research reflects social ecology's general concern 
with t'he relationships between physical, cognitive and social 
aspects of behavior milieus iLewin, Barker, Soskin' and John, 
Moos); the present investigators' particular concern with wh^ 
or what controls these different aspects of the environment 

(Goffman, Bernstein, Grannis) ; Occupational psychology's 
concern ^with the levels of people, da'ta> and things tunctioning 
that are characteri-stic of different jobs. (Fine); sociolmquist^cs 
concern with the effects of different settings on language use \, 

(Gumperz, Hymes) ; and an. interest m relating ail these concerns* 
to the environments of the students' educational and vocational 
development. 

The point ot view reflected here is that students 'in late 
adolescence have alr'eady developed basic communicative compe- 
tencies and skills of functioning with people, data, and things 
in v^ious contexts familiar to them and that what is now at 
stake in. , their education is the articulation of these compe- 
te^ocies with »the . specif ics of new contexts, in the present * ' 

case their adaptation to the particulars- of health career'v 
/ ' ^ ( 



Each student was observed for a tiptal of- about 7 observer 

V 



ERIC" 



oriented actitivi-es, MethadologdcaJ^y , this gives priority' 
to comparing settings to establish which evoke the highest 
level student perf ormahces , rather than concentrating on 
the gains emphasized in the pre-test/post-test model of ^ 
learning. 
Data Sources 

A purposive sample of 14 students, str^atified wi'th 
resSLct to gender, ethnicity (Black/Hispanic) , entry Metropoli- 
tan Reading Test: score (ab9ye 8,0/lDelow 8,0), arid Nowicki- 
strickland locus of control S<^ore (externals >above 14/iriternais 
below 11-) , was drawn from the student population of 30. 
Data' Col lection 

hours in his or her classes and project aUd/or placement |^«'^ach 
observation required two observers • One observer used a Setting 
Behavior Inventory (SBI) while tfae oUiSr simultaneously emf^lbyed^ 
a Verbal Behavior Inventory (VBI) Both of these instruments 
were developed tor this assessment pursuant to objective fl 
described above. ! ^ 

The SBI recorded over successive five minCite intervals 
an inventory of the people (sch(^I or hospital staff, student 
peers, and patients or other individuals), data sources, and^ 
things related to a subject's activ<ity; staff's, pelfs', and 
subject's highjest levels of functioning with people, - data, 
and things; the format for interaction between the subject 
and 'Other pebple .m the setting; and the subject's levels 
of activation, initiation, a|^d .involvement . These* categories 
reflect an amalgamation of categories, from Grannjis' previous 



research on classroom environments and the. system of analyzing 
levels of people, data, and things functioning^ developejd by 
Fine for the Dictionary of Occupatio»al Titles to analyize 
jn^rti^a^y all jobs in the eqjohomy. The advantage of using 
the D.O.T , soheme is the possibility of making direct 
coiftparisons between the functioning of students and the ' 
functionings required in or characteristic of different occupa^"^ 
tions.' This is the first Research m secondary school 
education to use the D.O.T . system* to e-xamine studento ' and 
staffs levels of functioning in i^oth school and work related, 
contexts. f 

f Wh^le verbal^ as- well as nonverbal benavior figujred in 
thp SBI observation, the VBI examined -the verbal behavior* 
in much greater detail, recording the goals, task ^relatedness , 
symmetry and participant structure of the verbal interaction 



fes a whole as well as the frequency and direction of 'solicits* 
(uttera3;ices exhibiting. CQntrol strategies} over five minute 
intervals concurrent with the SBI observation. 

The subject wore a wireless microphone and a tape 
recording "was thus made of the verbal interaction in the-*s,ub ject 
vicinity, finally, subjects were debriefed following- selected 

. \ ^ ■ ^ 

observations and all subjects were int^^rvi^wed about their 
experiences in the program at- the conclusion- of tne school year. 

Interobse^er reliability of ^70 or higher was obtained 
for *all the variables employed m this research- report. 
Data Analysis 

Mean percentages of time varioua conditions prevailed 
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co-operativeiy in concrete tasks. These optima'l staff roles 
were open to subjects' splicifmg, and were adapted to ' " ^ 
subjects' competencies and knowledge. This was reflected 
in an overlap between the conjplexity or power of staff's 
and subjects' people and data funtioning, and in the medium 
intensity of staff activity and "the joint initiation that 
characterized the. highest levels of subjects' people, data 
and things* functi9ning, and subjects' soliciting. Qualities 
of the verbal interaction or verbal context that accompanied 
these nigner levpl performances included* partially (as 
opposed to highly) task related talk, nigh rates of peer 
participation, and, m settings with greater numbers of peers, 
participant sturctures that allowed for multi-stranded conversa- 
tions. ^ Low readers solicited much more than high readers, but 
did so in the more formal or mixed formal and non-formal 
settings and in general appeared to adapt less well to the 
comnfunicative re'quirements of the non-formal settings. 
^ These optimal conditions for subjects ' performances 

seemed to represent an intersection of formal and non-formal 
r 

educational conditions within settings. More generally, the 
program appeared to synthesize' its more formal and non- formal 
aspects in sucJa a way as 'to enhance students' performances 
and. learning overall. An issue which tne hospital placements 
usually, but not always, successfully resolved was the potential 
conflict between accountability to. tne students' education and 
accountability to the unit's standards. This' is liicely to be 
an issue m other work settings of education. The findings* 
warrant further investigation of tne complementarity, ot 
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aifferent settings in eliciting high level student 
performant:es / and suggest the possibility of monitoring 
wide variety of settings to give feedback to program 
participants and sponsors. , 
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During the 1976-77 school year, 90 students from 
two New York City high schools spent their senior year in 
the Secondary Education Through Health (HETU) Program at ' 
the Mount Sinai Hospital.' All of the student^ were members 
of Black or Hispanic low-income families. Their average 
reading level at the beginning of the yoaT was 8.0. All of - 
the students had. evinced sorr.e interest in a medical or 
environmental health' career priof to their coniing to SETH. 

This report focuses^ on the. quality of the students' 
experience in SETH. In so doing, it addresses itself to the 
larger question of* how one documents and evaluates the 
experiential aspect of an environmental health curriculum, and' 
of environmen^tal e^^b^^ion programs more generally. i 

"Experiential -education': engages learners directly 
with the referents of • their learning-ob] ects , people, activi- 
ties! and problems not> just invented for * teaching . -In an 
environmental heal th^ program , this most obviously includes 
coUect>ng primary d^ta on pollutants in the commu'iii^y, partic- 
ipating with professionals in laboratory and' patient ' care 
settings, and communicating^ with the . producers , .the consumers, 
and policy makers involved in' the. ecortomics arid politics of 
pollution. • ^ 

STUDENT PR0GRAJ4 ; \ . . • ' * 

All of the students pursued a science course com?rise<5' 
of six environmental health units designed by, SETH staff. They 
also took regular Mew York City Board of Ecucatioh English, 



mathematics,, an<gLsocial studios courses tauai:rt'on the hospital 
prlituses. These four courses occupied the students, eight half 
days a week throughout , the year, 'in addition, th^ 'students 
spent two mornings a week in. an environmental placement or 
' project . . • """"^ ^ 

The placements involved working as aides, assistants, 
and clerks in a. variety if patient care and research, settings: 
Prenatal Care, EKG, Denial Care; Microbiplogy Lab, Emergency 
Room Lo^/ Blood Bank, aS^othen sections of the Mount Sisiai > 
complex, and an Snvironrr.ental Protection Agency office outsidj 
Mount Sinai. The projects included publication of a bulletin, 
reportirf^ on local health hazards, and the production of' aWies 
of videotapes on the effects of #uch pollutants as noise, . - 
asbestos, and lead on the health, of individi«^and groups'in the' 
East Harlem conmunity. Some students were engagedin a -single-' 
placeme-nt or project for both semesters, while others switched- ' 
from one assignment to the other at midyear. The scrence course" 
the placements, and <:he^ projects were all construed as components 
of the .Environmental Health core of the SETH program. ■■ 
ASSUMPTIONS : ' ] ' * ' ' 

Like experience, involvemei%t implies "doing" rather' than' 
]ust passively observing.' Listening and watching may. indeed entail 
covert thinking and feeling, and can on occasion iie. highly 
involving in this sense. However^ experiential educators from 
Dewey to Piagef have argued that some sort 'of interplay b^we^n ^ - 
external and internal -actionTs is necessar-/ for thQ^^trir^d^^^^ * 
ment of thought \nd feeling. The gap between abstract ide^s and 
tfieir concrete refeieVits, the fact that abstractiorts have been 

■ -.10 - • 
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lifted out of conte:cts in which typically rr^any factors are at ' 
work, and a learner* s need to test competencies, ask questions, 
express reactions, and obtain feedback in "'real time" sequences, 
all are aspects of the argument. for experiential education. 
^The alienation of many students from purely formal education, 
especially students like those who came to' SETH, is alleged to 
stem from the failure to provide oppprtuni ties' for them to 
operate, in, and on, the contexts their learning refe-rs to. 
SETH'S LgARNIMG OBJECTIVES : 

Three general categories of objectives for students in 
the Environmental Health core of SETH were referred' to at 
various .pointlfe in the proposal for 1976-77 . These can be 
summarized as (1) developing in the students an ability to 
apply ecological concepts to environmental health problems, 
(2) involving them in siti:^a^ons where heaLth problems are ^ 
being recognized and met, and (3) developing in them en-try level 
skills for medical and environmental health careers. Products 
of the students* activity— news bulletins , videotapes, charts, 
essays, tests, and content oriented interviews of the students — 
furnish the major evidence bearing on the first of these ohjecti". 
This evidence is discussed in a parallel' report (Appendix D) . 
Observations of J:he students "in situ", post observ*ation de- 
briefings, and a questionnaire to tap students* perceptions of 
their science classes, placements, and projects as .work-study 
environments, furnish the principaijjpl^idence of the quality of 
the students* invol^vement in environmental health situations, 

and/ their development of health career related skills. This is 
♦ 

the evidence presented and analysed in this present Section of- 
f 

the evaluation report. , 

- 11 - , '"'^ . ^ ■•' ■ • 



SETH was not a paraprof js^xonai training program, 
nor would that necessarily have been the most valid way to 
N interpret its ai.-n to develop entry level skills for rnedi^^al 

and health environ.-nent careers. On the formal side of cheir 
learning, the students' inprovonr.cn t of reading and writing,, 
mathematical, scientific, and civic literacy was aimed at 
their gaining entry to post-secondary school educational 
programs for health related careers. On the non-formal 
side, styidents would be considered to be "entering" if thev^ 
could be observed actually functioning at higher levels than 
simply taking instructions , copying m form.at ion , or handling 
materials in health research and treatment contexts. In 
other words, if students were using an environmental research 
team's categories to classify data, or were manipulating — 
physically coordinating various elements of — laboratory equip- 
ment to conduct a test' on some materval, or were adapting to 
staff in a division of labor for a concrete task, these ' * 
activities would evidence their participating in the intellec- 
tual, physical, and social work of the environmental health 
settings, and thus their manif esting'^^tering skills. 
EVALUATION FRAMEV/ORK : 

The SETJd program evaluation^ describes the various program 
' settings and the students* performances in them*. 

In recent years, as alternative educational programs have 

^ prolif era ted-^'including a large number of environmental education 

programs — it has become increasingly clear that an assessment of 
*. . > . 

student performances must be able to specify the conditions under 

which tlie pertinent behaviors wore obsorved (Charters and Jones, 

1973)'. 

O -12- - . . 
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It is a cucsticn of cominq to understand 4/hat settings 
evoke students* competencies, and finding out. as precisely as 
possible the characteristics of these settings that might be 
associated v;ith student performances . 'One wants to know not 
only about the students' functioning, but what the students 
have been exposed to in settings wh^re they themselves are 
not externally active, yet where, their attention manifests'a 
* h^ch decree of internal involvem^ant . 

Ip short, the er.viror.mer.t *o: the students* behavior 
must be S'uudied. Congruent with its airs :cr the students 
themselves, SETH chose an ^environmental approach to the assess- 
ment of the quality of the students' e':<perience in the program. 

Adolescent students have already developed skills of 



interne 


rsonal relating, data classification, and so on. 


in 


various 


contexts familiar to them, so that what is at st 


aKe 


is the 


further development of tliese competencies in new 


con- 


texts , 


in the present case their adaptation to the soeci 


f ics 


of heal 


th related careers. What evaluation must examine 


in 



experiential education is not learning thought to take place . 

simply between the begifining d^f a program whe'n it is not 

; - ' 

manifested and a later point in time when it is, i . e . ^ the 

gains of the conventional pre-test/post-tes t model of learning. 

Experiential education postulate's that certain settings 

more effectively evoke capacities th^t the students have already 

developed: capacities to deal with people , 'data , and things, that 

are not suspected because the students do not display them in 

more stereotypical classrooms. Ideally,' interplay can be 

envisioned between the non-formal and the formal aspects of a^* 

- 13 - 
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prograri such as SETIi's. The no.-.- forn^a I engagement of the 
Students' competencies creates experience (experience is 
not independent of action) which formal instruction then 
makes more generaiizable especially through the labeling 
of the experience. The formal learning, in turn, renders 
more information available in the non-formal settings, 
thus generating still more experience. Central to all this 
is the control that the students gain bver the , conditions 
of their/learnmg and experience. SCTH sees the overlap 
between the formal and non- formal, or academic and experiential, 
as crucial to enhancing th^ studentis' control. This overlap ^ 
IS spoken to again in the section' that follows. , 
SETTINGS IN SETH : 

The SETH program included settings that'were formal, 
non-formal, and mixed formal and non-formal, i.e. , different- 
combinations of didactic and experientiii . These settings' 
are sche.matized in the following way: 



\ 

\ 



GENERAL EDUCATION 



ENVIRONMENTAL HEALTH EDUCATION 



English 

\ 



\ Mathematics ^ Science Course Projects Placements 

\ Social Studies ^ 



I FORilAL SETTI NGS ^ . N(^\-FORMAL SETTINGS 



English, mathematics, social studies, and science were 

all pursued^ in classroom settings where there was a "teacher", 

✓ 

an individual whose principal' role was teaching, and where the 
verb.al expository pro'portiofi of ^the activity was presumed to 
be -relativ-ely high. 
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Placements entailed the students' participating in 
out-of-classroom settings where there was typica^lly no one 
whose principal role 'was teaching, and where the verbal 
expository proportion of the activity was presumed to be 
relatively low. ("Presumed" ref.ers here to the'usual 
assumptions about formal and non-formal settings; see 
Scribner and Cole, 1973 These .assumptions will be checked 

in the data analysis below.) ?ro:ec-s inv*olved students ' in ' ' 

/ ' 

the observation ar.d analysis of health environments outside' 
the classroom, but were conducted at least h>lf of the time / 
m irlassrooms, and ware led by SETH teachmc staff. Thus thev 

O » - 

X 

might.be expected to have manifested a mix of fonnal and 
non-formal characteristics. in addition to more verbal formula- 
tion in the formal setting,- these characte:^istics includes more 
"why" questions and explanations and" less connection between 
language and action. The non-formal setting is characterized 
by more learning associated ' with using a tool or scheme to 
accomplish some' immediate purpose, rather than learning something 
to accomplish a future purpose; more learning by observation 
and imitation and more learning through identification and 
coope'ration with those- who have skills in the non-formal 
setting. (Scribner and Cole, 1973.) 

« 

f 

To make judgments about students' and staff's performances 
in the different program settings, SETH used an adaptation of the 
system for analyzing levels of data, things, and people- functioning 

^ . Scribner, Syly-ifl nnd f-'-ictiflcI foli'. Cnr.nilivc con<;cmiGnccs of fortrni and 

informal e<!ucatlon. Sc i once , j*^?;^ 1*^71, 553-559. 
\ - 15 -T* ' , ■ 



that is employed m the United Scates employment Service's 
Dictionary of Occupati onal Titles *. (D.O.T. is used to analyze 
virtually all jobs in the economy.) 

^ The idea of J'levels" here i^V^a hierarchical qfie . Skills 
at one level of functioning are'i<:o>sidereG to be more compre- 
hensive or complex than those at a lower. level, and thus generally 
subsume those at lower levels, as, for example, the in'tellectual 
skills of analysis subsume those of sheer information retrieval ' 
and comparison. » 

The potential advantages of using the D.O.T. scy;^me"are 
irrjnediateiy evident^. Instead of relying soley on more general 
or anecdotal testimony that students were involved and useful 
in the work settings, one can ask precisely what levels of 
staff functioning students are observing and coordinating with, 
and what le^^J^^^hey thems'elves are functioning on. 

Thife use pf the D.O.T. scheme links environmental 

education with career education by analyzing the environments 

1 

and activities of the students' education in, career orien^ted 

^SETH i? t he first project i'n secondary school eddgation 
to use the D.O.tI , system to exa;nine students' and -staff's 



levels of functioWnq in both school and work related conteVts 

* Washington: U. SV Department of Labo'^ ^ 
U. S . Employment \service ^ ' 

DiGtion.ar y of Occupational Titles. (2\ vols 3rd ed . ; 1965.). 
See also Fine and\Wiitiv, 19 717! 
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SETH supplemented the D.Q.T. scheme with an analysis 
of veri?^l soliciting behavior of students and staff in the 
various prograr: settings. Verbal soliciting behaviors are all 
those verba^ behaviors that call for a response from an addressee, 
i.e. questions', eequestg, d<^Mnds, suggestions, contradictions, 
and so forth — in sum, verbal behaviors that call for a 
response from the addressee. 

Students' questioning had been identified by SETH staff 
as a ?ar;iicularly important learning behavior that they wanted to' 
foster. A member of the evaluation unit, Schwarz , who had been 
a teacher with SETH m a previous year, had oriented to verbal 
soliciting more generally as crucial for the students'- gaining 
access to new. information and situations. Schwarz views verbal 
soliciting as being greatly influenced by language context, l.e^. 
the setting conc&tions for language behavior. 

Higher rates of students' soliciting related to health 
environment topics or activities, together with hiqher levels 
of students' data, people, and things functioning in health 
environment contexts, were defined as the principal student ^ 
behaviroal objectives of the SETH Environmental Health Program . 
Involvement, a measure of the intensity of a -subject^'s attention 
or arousal to a task, w^as also included in the behavioral' 
objectives for subjects. 
PROCEDURES : 

The evaluation unit developed a detailed observation 
scheme to explore a/broad range of setting features along, witji 
students' levels of functioning 'and verbal soliciting. Both 
the number of subjects and the nuiTib^r of observation hours were 
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limited, in order to. make possible this .breadti'h, a^d to allow 
time for th'e-anlysis that the. data lent itself to-. = * 

Earli^ in the Fall semester, a p,urpos4ve sample^ of 14 
subjects was selected for observation' &nd case s tud^. ' Students' 
ethnicity, 'crender, Metropolitan ^Achievement Test reading 'score , 
and Nowicki-Strickland locus o^6ontrol score, were used to 
_set up categories. _ The Nowicki-Stricklar.d 'instrument determines 
the extent to which an ' individual pe-rceives that can 
influence the outcome of valued -events rn life, (like having 
friends and doing well in school)' as opposed to those being 
determined by fate or' forces beyond one's control (referred to 
as e.xternality in this study). Perceived locus of control. has 
been shown in other research to porrelate with' nany other 
attributes of individuals, particularly educational and oscupa- 
tignal aspiration and achievement. This variable was controlled 
for in the present research, other variables controlled 
for were ethnicity, gender, and reading score, which ^peak for 
themselves as potentially important variables among students. 

Fourteen sub3ects were randomly drawn from the categories 
formed with these variables. The subjects were distributed as 

follows: ' 

TABLE 1 * 

Distribution of Observation Subjects 

Black Hispanic 

Mai e Ferr.ale ^ M ale Female 

High reading, 

high external 1 110 

Sigh reading, ^ ^ 

low external 1 1 1 1 \ 

Low reading, 

high external 1 1 1 ' - 1 

Low reading, ' , ' 

low external 1 1 0-1 



There were no malo Hisp..,-.ic stucGnts who were low ,o> 
both reading and externality, and no female Hispanic students 
high on both reading and externality, at' the time of selecting 
the sample , • ' " , 

DESIGN: . ' - 

Since each student was being obser\red in various,' 
, settings, each student ^^-as his or her own control,, for the ' 

purpose of comparions' of student behavi'or in different settings. 
.Comparisons between hiah and lav; reading, male "and female 
students, etc., ^an also be made, though tKey have bein constrained 
by not having students of every trait combination m Table 1. 

Each or the 14 subjects was observed individually in 
both class and placement and/or project settings, during"' -the 
Fall and the Spring semesters for an average total of about 7 
observer hours per subject. in addition, a variety of informal ' 
observations were conducted in the different, settings , and /Q^h ^ " 
^ subject was interviewed bcjjth formally and informally at various 
4^,„ times. 



''t;'TH£ OBSERVATION INSTRUMENT: 



Two systems of . observation were used - each system and 
observation required its ^wn observer. One observer used a 
Setting and Behavior ti^ventory (SBI) while the other simultaneously 
employ'ed a Verbal Behavior Instrument (VBI) . These instruments, 
both of which were developed for this assessment, have been 
described in-*a previoi»s report. (SETH Evaluation Unit First 
Progress Report, 1977.) In general, the. SBI recorded at 
successive five minute intervals an inventory of 'the beople 
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(school 9r hospital suuT , sluucuu pcorV; and patients "or 
othlr. individuals), data sources,, and thpgs- related to a sub- ' 
Dect s activity; staff s, peers.', and ■ subject • s highest levels, 
of functioning with people, data) and ,things; the format for 
interaction between the sub]oct. and other/pe^ople in £he setting; 
•ar.d the subject's level of activation, initiation, and Jnvolvenl? 

While verbal as well as nonverbal behavior figured in ^he 
SBI observation, the VDI examined the verbal behavior i-ft much . 
greater fietail; recording the goals and task relate'dness of 
this behavior, "and che frequency and direction of Solicits 
(verbal utterances seeking a response) and responses", over 
five minute intervals concurrent with the SBI observation. ' , 
.The two observers also made informal notes on the settings and 
•behavior. - The subject wore a' wireless microphone, and a 
tape rebording wi's thus made of the verbal interaction in the 
subject's vicinity^. FinaUy, subjects were debriefed following 
select^ -observations, and all sub]ects were interviewed 'about 
their classes, projects and/ar placements, at 'the conclusion of 
the school year. ^ 

An .interobserver reliability of at least .70 was 
obtained for each of the observation variables in the form in 
which they are presented in this report. A number of the 
variables have been cond<^nsed from finer discriminati6ns ii 
order to obtain this reliability, and for greater -economy of 
reporting. 

The fact that the observers followed individual subjects 
for periods of time varying between 15 minutes and an-hour.and 
a half means tha{\ various specific observations were, likely to 
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be repeated from onq :ivg minute intervai to another. ^or 
example, if staff was leading a discussipn durin'g a given 5 
.mi^nute interval, and subject ^was listening but not speaking 
. or taking notes during this time, there was a certain likeli- 
hood that staff continued to lead a discussion during the 
ensuing 5 minutes, and, i C not with the same probability, 
\ that subject concinued simply to listen'. This ^ inter-dependence 
of the observations from one 5 mi^nute interval to another 
within an observation session for a given subject vioPates 
^ the assumption of non-interdependence made by most statistical 
tests of significance. It is possible to locate' these so-called 
Markov chains of sequentially interdependent observations, and 
to test th^e significance of transformacions of the data. 'However, 
this procedure wafi^ judged to be too elaborate for the prese;at 
study. Jt would have higher payoff for "a subsequent study that 
fi*rst of ^11 -rnodif led its categories and sampling procedures 
in accordance with the most obvious things learned from this 
^ present exploratory study'. This will be discussed fur.ther'in 

a concluding section.^ The findings of the present report will- ' 
- IjA^presented as percentages and cro^s-'liabular trends, with.no 
, attempt to ascertain their statistical significance. ' .'^ f 
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ifftxnu' ?" °^ thc'concral Uduc:r.,on and. Health Environment 

The_ strategy of this first ■ analysis is £o use, the 
General Education classes - English, mathematics, and social 
studies - as relatively familia.^ baselines ' from which to judge 
the properties of the 'Health Envirc^cnt settings and the' 
performance of subjects observed in them. 

, Tjfie ST;TH English, mathematics, an^ social studies were 
carefully planned courses in which the degree of' students' 
involvement generally appeared to' be highe^" than one has come ' 
to expect in inner-city classrooms. In their end-of -ye'kr class 
rat£;;gs,^th^e 'subjects rated these ' cbu;:ses in mostly positive 
ternjs^^he General Education courseV, then, are^ not straw men 
for this comparison. 

Table 2 summarizes the proportions 6f time the subjects 
were observed under var/ous conditions in the General Education 
and Health Environment settings of SET>i, and the proportions 
of time the subjects manifested various behaviors in these 
settings: Jtie long table is easily read and can be" 

approached as an abstract of these first findings^ Tor each 
variable, fore/ample School or Hospital Staff Presence, the 
percentages add up to 100% within each of the four categories 
of se-ttings included, the General Education classes, the 
Enyirofimental, Science classes. Health Environment Projects , 
^and Hospital or Agency Placements. Thus subjects were observed 
in General Education settings . without peers 1% of the tot^l time 
observed in the General Edutation* classes , 12% of the time with 
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1 to 5 peers present, 17*^0 with G ,to 10 peers present, and 
70^^with 11 or more peers present:.'; This ^neans that the ) ^ 
subjects* virtually never were observed in isolation from 
other students in the General Education classes, though . , 
they were found in small or medium size groups some of the 
time. With respect to the question of what interaction 
formats were employed m the , General Education classes, 
the 100% of time that subjects were observed in these 
classes breaks down into 10% lecture or demonstration 
formats/, 57% discussion, 32% supervised task, and 1% 
u/isupervised task, ' - ' 



r 
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TABLE 2 



Proportions of .time subj^ts were observed unc^r various 
conditions in eac^ SETH .Program component. \ 

' ■ ' \ ' 

(2U intervals of observation 
in special settings are omitted 
from this table but included in 
subsequent cross tabulations.) 



GEN. ED. 

Gen. Ed. 
Classes 



HEALTH ENVIRONMENT 



Env.Sc. 
Classds 



Total number of 5 minute 
intervals observed. 



A. 



145 

SOCIAL ENVIRONMENT 



Level -of staff activity 
in relation to subjept 
over, 5 minute inteirvals- 



72 



9 



^ 0 

Prpject Placement 



105 



210 



0.= 


Not present in sub- 






ject' s vicinity. 


• 12% 


. 1. 


Present, but. not 






active with S. 


11% 


■ 2. 


Active With S part 






of 5 minutes 


30% 


3. 


Active with S most 






of 5 minutes 


47% 


B. * Peers prese,nt with 




subject 




0. 


No peers in setting 


1% 


1. 


1-5 present 


12% 



2. 6-10 present 

3. 11+ present 

C. Interaction format 



17% 
70% 



1 . Lecture/demonstration 10% 

2. Discussion 57% 

3. Task supervised by or 
co-operative with staff 32% 

4. Task independent of 

\ staff lA 

Staff people functions 

0. No staff relation- 
ship to subject mani- 
fest 3% 

1 . Instructing, conducting 
recitation * 56% 

2 . Supervising , modera- 
ting discussion 34% 

,3. Consulting or lower 

power function ' 7% 
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6% 


7% 


27% 


7% 


5% 


6% 


18% 


' 34% 


16% 


69% 


54% 


51% 


0% 
0% 
35% 
65% 


0%. 
55% 
39% 

6% 


74% 
23% 

0% ■ 


4% ' 
76% 


1% 
- 19% 


19% 
. 4> 


20% 


65% 




0'% 


15% 


34% 

i 




/' 




• 0% 


10% 


34% 


54% 
^4 6% 


46% 

/ 

/ 14% 


.16% 
25% 

9 


0% 


30% 


' 25% 



2G 



J 



GEN, ED 

Gen. Ed. 
Classes 



HEALTH ENVIRONMENT 



Env.Sc. 

Classes. 



Project Placement 



Subject people functions 



0. 


No relationship to 




f 








people manifest 




0% 


10% 


24% 


1.- 


Taking instructions, 


^ y • 










helping " , ^ ^ 


34% 


55% 


18% 


31% 


2. 


Exchanging informa- 


. ^62% ) 








tion 


• 32% 


31% . 


18% 




Servizxg ot, higher 


12^ ■ 








power fiunction 


- 13f • 


• 41% 


27% 



E. 



Initiation, direction 
of ongoing activity 



1. others initiate only 


61% 


*54% 


32% 


30^ 


2. Subject and staff ^ 








w/w.o. peers* 


^^6% 


32% 


50% - 


32% 


3. Subject and peers 




< 






only 


8% 


0% . ■ 


18% - 


8% 


"^v Subject only 


5% 


14% 


0% 


, 30% 



Subject: activity level 
over 5 mins. 



0. 


Off task ' 


7% 


1. 


Obser-zing only, 


26% 


2. 


Overtly active part ' 






of time - ' 


■ 50% 


3. 


Overtly -active most 






of time " 


17% 



0% 
40% 

44% 

17% 



H. 



Intensity of subject's 
attention' or arousal 
to task 



/ 



/ 0. Off task 
1 . Low 

Medium 
High - * 



2. 
3. 



8% 
24% 
52% 
17% 



0% 
21% 
54>> 
25% 



INTELLECTUAL ENVIRONMENT 



se of symbolically 
encoded data 

0. ' Not used in setting 

1. ' In use in .setting 



7% 

93% 



8% 
92% 



0% 
13% 

54% 

33% 



18% 
82% 



1% 
14.% 

32% 

54% 




24% 
76% y 



* GEN^ED, 



HEALTH ENVIRONMENT 



Task aovelty 

1. Familiar situation 
and information 

2. Familiar situation^ 
new information 

3. New situation, 
familiar information 

4. New situation and 
information 

Staff data functions/ 

/ 



0. 
1. 



I. 



taff not ijv^etting 
Data functions not 

manifest / 

2. Low data/function 
/Level 

iMediumv levels 
4. Hi^gh levels 

Peer data functions 

0, Peers-Bo€. 4.n; 

setting*' 
\^ Data f uigctions not 

m'anif.est C 

2. Low d^ta function 
level. ' 

3. M^^iaitan levels 

4 ^•'"^'igh levels ' ^ 

< > 

Subject data functi 

Dat^ functions 
manifest 

2. Low data fvmction 
level 

3. Medium levels 

4. High levels 




Gen. Ed. 
Classes 



5% 
88% 
1% 

6% 

12% 
10% 
18% 

a% 

19% 

1% 

26%' 

13% 
55% 
6% 



27% 

26% 
44% 
3% 



Env. Sc. 

Classes 



40% 
42% 
10% 

8% 



6% 
1% 

5^% 

39% 
0% 



.0% 
4% 

68% 
26% 
1% 



10% 

63% 
28% 
0% 



Project "ylacement 



PHYSICAL ENVIRONMENT- 




Lpul^give , objects 
^her tiiafi '^eaa^^J^g 
writiing inaterial^J 
used in setting 

^r^^o'c used in setting 
1.'" Used in setting 




100% 
0% 



7% 

67% 
2% 

25%, 

7% 
12% 

5^% 
22% 



0% 

5% 

7% 
71% 
17% 



8% 

i2ii 

66% 
14% 



26% 

74% 



' 20% 
61% 
1% 

18% 

27% 
10% 

20% 
27% 
17% 



^74% 

10% 

10% 
4% 
1% 



25% 

32% 
39% 
4% 



21% 

79% 



GEN . ED . 

Gen, Ed. 
Classes 



HEALTH ENVIRONMENT 



Env.Sdy 
Classes 



Project Placement 



. 0. Staff, thing functions 

0. Staff not using 
things 

1. ' Low 

2. High 

P. Peer things functions 

0. Peers not using 
things 

1 . Low 

2. Vfiqh 

Q. Subject things functions 



96% 
1% 
3% 



97% 
3% 
0% 



100% 
0% 
0% 



100% 
0% 
0% 



49% 
0% 
51% 



30t 
11% 
59% 



45% 
12% 
43% 



87% 
13% 
0% 



0. Subject not using 
things 

1. . Low 

2. High 



R., Talk continuousness 



I 



95% 
5% 
0% 



•10t)% 
0% 
0% 



VERBAL ENVIRONMENT 

\ 



41% 
33% 
26% 



26% 
51% 
23% 



0. Silence 

1. Sporadic talk ' 

2. Continuous talk 



1% 

20% 
79% 



1% 

10% 
89% 



3% 

45% 
52% 



16% 
52% 
31% 



Talk task relevance 



0. 
1. 
2, 
3. 



Silence 
High 

Partial'^ 
Unrelated 



1% 
78% 
17% 

4% 



1% 
96% 
3% 
0% 



3% 
58% 
31% 

8% 



16% 
76% 
4% 
3% 



% of peer participation 



0. Setting silence 

1. 0 - 10% 

2. 11 - 50% 

3. 51 - 100% 



1% 

35% 
38% 
26% 



1% 

26% 
57% 
15% 



3% 
14% 
32% 
51% 



16% 
65% 
7% 
12% 
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^GEN.ED. 



HEALTH ENVIRONMENT 



Gen. Ed. 

'Classe'S 



Env.Sc 
Classes 



Project Placement 



Goal of Talk* 



0. 


Silence 


1% 


1. 


Assist manipulation 






of object 


61^ 


2. 


Explain, demonstrate 


-3. , 


' Theoretical 


• 42%' 


y- 


Future .or pABt 




perfoirmance 


28% 


5. 


Not related to 




6.' 


task • 
/A'ffect 


14% 
6% 



Subject's rate of 
Soliciting 

0. None in 5 minute 
interval 

1. 1-3 

2. 4 - 6 V 

3. 7+ 



50% 
32% 
10% 
- 8% 



1% 

0% 
89% 
36% 

17% 

1% 
3% 



49% 
29% 
14% 
8% 



3% 

47% 
27% 
23% 

22% 

12% 
10% 



17% 
46% 
18% 
19% 



16% 

40% 
40% 
23% 

19% 

9% 
4% 



46% 
37% 
9% 
• 9% 



* More than one goal of talk could be noted during a 'five 
minute interval, and thus the column percentages -add to more 
than 100%. 
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SUBJECT'S RATE OF SOLICITING — " ~ 



2 
O 

H 
< 

M 
O 

> 

o 

2 



None 



1-3 



4-6 



7+ 















Familiar 


59 


25 


•2 


1 


87 


67 . 8 


28.7 


2.3 








25 . 3 


12.5 


2 . 0 


1 . 8 






152 


128 


48 


51 


379 


Mixed 


40.1 


33.8 


12.7 


13.4 


. 68 . 2 




65.3 


64 .0 


72. 8 


89 .4 






22 


47 


16 


5 • 


90 


New 


24 . 4 


52.2 


17.8 


5.6 


16.2 




9.4 


23.5 


24.2 


8 . 8 






233 


200 


66 


57 


556 




41.9 


36.0 


j.;l.9 


10.2 


100.0 



TABLE 3 

Rate of subject's soliciting by novelty of 
the situation and information. 
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SUBJECT'S RATE OF * SOLICITING 



O 
2 

M 

2 
O 

M 

u 

2 
Z> 
tu 

CO 

o 

2 
M 

CO 

u 
w 

^^ 

OQ 

CO 

o 

pa 
> 
pa 

»-3 





None 


1-3 


4-6' 


7 + 






152 


104 


37 


30 


323 


None 


47.1, 


• 32,2 


11.5 


9.3 




65.2 


52.0. 


56.1 


52.6 


58 1 
















61 


65 


•17 


14 


15 7. 


Low 


38.9 


41.4 


10.8 


8.9 




26.2 


. 32.5 


25.8 


'24.6 ' 


28.2 




20 


31 


12 


13 


'76 


High 


26.3 


40. *8 


15.8 


17.1 


13.7 




8.6 


15'. 5 


.18.2 


22.8 






233 


200 


66 


57 


556 




41.9 . 


36.0 


11.9 


10.3 


100. a 



TABLE 4 

Rate of subject * ^ soliciting 

by subject's things functioning • 
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< 
O 

< 

o 

M 

cn 

O 
H 



■ ..SUBJECT'S- 


SOLICITING 


RATE 






No 


1-3 


4-6 


7+ , 


Solicits *■ 


Solicits 


Solicits 


Solicits 




40 


0 


0 


0 


Setti'ng • Silence 


100.0 


0.0 


0.0 


0.0 


• 


17.2 


0.0 


0.0 


0.0 


Highly Related 


164 


171 


54 


37 


38.5 * 


40.1 


.12.7 


8.7 


Talk 


70.4 


85.5 


81.8 


64.9 




17 


21 


12 


19 


Partially 


24.6 


30.4 


17. 4 


27.5 


Related Talk 


7.3 


10 . 5 


X o . ^ 






12 


8 


0 


1 


Unrelated Talk 


57,1 


38.1 


0.0 


4.8 




5.2- 


4.0 


0.0 


1.8 














233 


20,0 . 


* 

66 


57 




41.9 


35.9 


11.9 ■ 


10.3 



\ * 



40 
7.2 

426 
76'. 6 

I 

69 

12.4 

21 . 
3.. 8 



556 , 
100 .0 



, TABLE 5 , ■ 

Rate of subject's soliciting by 
relationship of .talk t^ task. 
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SUBJECT'S RATE OF SOLICITING 



None 1-3 4-6 ' 7+ 



108 


113' 


42 


' 34 - 


36.4 


38.0 


14.1 


11 4' 


46.4 


56.5 


63.6 


59 . 6 . 


125 


87 


24 


23 


48.3 


33. ^ 


9.3 


8.9 


5 3. .6 


4 3-. 5 


36.4 


40.4 


233 


200 


66 


37 


41.9 


36.0 


11.9 


10. 3 



TABLE 6 • 
Subject's ?ate of soliciting 
by subject's reading level. 
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SUBJECT'S LEVEL OF THINGS FUNCTIONING 



>4 

H 
> 
H 

U 
< 

U 

CQ 
D 
CO 

Ct. 
O 

o 

H 

H 
H 

2: 



V 


Nid^ne 


Low 


High 








31 




42 


7 




80 


Subject Alone 


38. 


8 


5-i . 5 


o o 

0 . 0 








9 . 6 




26.8 


9.2 




14.4 












- 






2 3 




8 


19 




50 


bUDject: vvitn 


•46. 


0 


Ib^. 0 


38 . 


0 




Peer (s) 


7.1 




5.1 


25.- 


0 


9.0 




97 




42 


42 




'l81 


Subject With 


53. 


6 


2 3*. 2 


2 3.. 


2 


32.6 


Staff 


30. 


0 


26.8 


55. 


3 






172 




•65 


8 




.245 


Other Al6ne 


70. 


2 


26.5 


3.3 




44.1 




53. 


3 


41.4 


10. 


5 






323 




157 


76 




' 556 




58. 


1 


28.2 


13. 


7 


100.0 



TABLE 7 ' 

Initiation of subject's activity' 
by subject's level of things 
functioning. 
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33 - 

35 



SUBJECT'S LEVEL OF DATA 
FUNCTIONING'' 



Not Manifest 


Medium 


Or Low 


Or Hiqh 


, 46 


40 


53.5 


46.5 


16. 0 


14.9 


23 


15 


60.5 


39.5 


8.0 


■ 5.6 - 


40 


89 


31.0 


69.0 


13.9 


33.2 


179 ■• • 


124 


59.1 


• 40.9 


62.2 


46.3 



288 
51.8 



268 
48.2 



86 

15.5 



38 
6.8 



129 
23.2 



303 
54 .5 



556 
100.0 



TABLE 8 



Subject's level of dat^f unctioning 
by staff activity level. 
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H 

O 

H * 
D 

o o 
< u 

w 

> X 

S: 

CO 

en 

u - 
w 

CQ 
D. 
CO 



-SUBJECT LEVEL OF DATA FUNCTIONING 



Not 



J ^ Manifest 


Low 


Medium 


High 




Not ' 


•11 


— ■ r 

27 


'29 


1 ■ 


68 




± 0 • ^ 


39.7 


42.6 


1.5 


12'. 2 


* 


9.0 


16.3 


12.0 


3.-7 ■ 






58 


72 


54 


2 


186 


Low 


31.2 


• 38.7 


29.0 


1.1 


> 


^ > 


47.5 


43.4 


22 . 4 


7 . 4 




• 


38 


42 


99 ' ^ 


11 


190 


Medium 


20.0 • 


22.1 


52.1 


■5.8 




• 


31.1 


25. 3 


41 . 1 


40 7 






15 


25 


59 


13 


112 


High 


13.4 


22.3 


52.7 


11.6 






12.3 

4- 


15.1 


u, 24.5 


48.1 


20.1 




122 


166 


24i 


27 


556 




22.0 


30. 


M3. 


5 


100 



TABLE 9 



■ f 



Subject's level of data fui^ioning 
by subject is level ^:^^^^^tionjirig 
with people. • 
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^ Overall the data sho^d tnat the subjects were not'' , 
passive onlookers in projects and placements, but tended" to 
be actively engaged in tasks in these settings, moire independently 
in the placements than in the projects . Environmental Science 
resembled the Geheral Education classes in^ being conducted 
modally in large group d-iscussions , but with at least a moderate 
participation rate. Staff in -projects and placements functioned 
at lower levels of power than staff in classes, in relation to 
subjects. Conversely, subjects in projects and placements . 
functiooed with people -- staff, patients, and peers, at 
somewhat higher levels of power' and complexity than they did in 
classes. Subjects participated more in the initiation of ongoing 
activity in projects and placements than in classes. It can be 
concluded that the projects and placements did have more of' the 
co-operation that is attributed to non-formal educational 
settings, it could also be said that the social environments 
of the different settings of the program complemented each 
other, -and that between them the students experienced and 
participated in a range of roles. 

. SUWIARY OF DATA FUNCTIONING OBSERVATIONS ^ 

In general, the subjects' levels of data funatibnlng 
appear to have been higher -than the level that has most 
frequently been attributed to students in .conventional class- 
rooms when Bloom's Taxonomy has been \i^d to analyze levels 
of cognitive functioning, sheer knowledge retrieval or recall. 
The one exception to this is the Environmental Science classes, 
where, once again, the observations disproportionately 
represented test related activity, and underrepreser^ted higher 
level data functioning that was often observed in informal 
visits to these classrooms.. That the subjects/ data functioning 
was .so nearly comparable in the General Education classrooms 
ERXC" placements is intriquing. Most of this functioning in 



y , placements took place m concrete tasks fdthei: than *in 

didactic discussion, and nearly half of ^these tasks were 

unsupervised. What difference the supervision made will be 

taken up later. The exceptionally hii^h levels ^of subjects' 

and staff's data functioning in projects points to the 

possible effects of combining didactic. and experiential^ 

aspects of activity. The^ high level of, data functioning in 

♦ 

the SETH settings overall,^ excepting the test sessions in 
^ Environnjental Science classes, might be evidence that the 

formal and non-formal aspects of the program did reinforce 
one another as the program model projected. Th^is cannot 
really be known without other settings for con\parison. In 
^ ^ ^ any case, tJhe substantial overlap between subjects' and 
^ c^'^^'Ttaf f * S' data functioning in both projects and placements 
implies that the subjects, and thus the students of whom 
they were a sample, were indeed exhibiting entry level ^ 
-cognitive skills for health envl?ronment careers. In the 
. , ' mo;5t literal sense, they entered into the data work of the 
project and placement tasks. 

MANIPUX^ATtVES IN TH? EN^^IRONMENT > 

Manipulative things other than writing materials — 
simple objects like test tubes and bed sheets, and complex 
tools or machines like a microscope or video camera and 
recorder — rwere rarely observed in use in the General 



Education classes, nevdr were observed in the Environmental 
Science clasps, but were observed being used three quarter 
of the time in both the projects and the placements. 
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When staff used objects, Lho ,iovoi of their functioning 
with (these) things tendc^d to relatively high. This mearrs . 
that they^ were more often observed manipulating, oE^erating - — 
controlling, and so on through setting up, the highest leveF"* 
of the-^ D.O.T , 30b things functions analysis scheme, and- less 

V * * * 

often just handling or tending things. Manipulating or 
operating video equipment, a microscope, a centrifuge, and 
tooth extracting equipment, were examples of this higher level 
^ things functioning. Student peers were infrequently present 



in" placements , buti in projects the modal level of things 
functioning that wasyobserved for peer^ was aVso manipulating - 
or higher, on^^^th^^ occasions ^vhen ob j^cts^^jv^re in use. 

Subjects themselves worked with ^things slightly more 
than half the Lime in projects, and three quarters of the 
time in placements, in both cases at low levels of things 
functioning more frequently than, at high levels. .While 
subjects did operate video and laboratory equiprrj^rrt approximately 
a qJiarter of the time jHdth-in projects and in placements, they 
were more. often observed in actions like Koldmg a mirror or 
a suctioning tube for a dentist, placing x-ray plates in a 
developing cabinet and later removing and^^ posting the plates, 
holding a microphone during an interview, and so forth. As 
these examples illustrate, however, even the lower level things 
functioning tended to be central to tPffe action in the subjects* 
letting. 

The^projects and* place»iW\ts clearly represented more 
of a "hands on'* ej^perience. for the SETH students. That- 
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physical objects were iiwolved -in projqct and placomGnt 
activity most o*f the time is. m lind with the char^cteriza-- 
tion^^of these as non-formal settings, and raises 'questions 
about the' interaction between things presence and other 
features of the settings, for example the uses "of language 
and the levels of data functioning in these settings. 

DISTRIBUTION OF SOLICIT A ND RESPONSI- RATES 

ACROSS THE FOUR PROGRvVl COMPONENl^ ~^ 

Soliciting is the major focus of . the pro j ect ' s 
research on SETH students' verbal outpuf. The working 
assumption -has been that the ijiore soliciting a student 
^oes, the mors control that student gains over the content 
and structure of his learning setting. Increased control 
is viewed as commensurate with a greater potential that- 
the student will learn from^ the setting — 

^tudies of student verbal performance in traditional 
classrooms have revealed a preponderance of student respond- 
ing over student soliciting. Studies^ of minority students* 

output; in schools have indicated that these students, 
-because of different language competencies, very often 
require other than traditional educational settings to 
become verbally engaged with cur^riculum materials at all. 
This section of the report presents the quantity of solic- 
iting and responding, SETH students, performed program-wide 
and how those quantities were distributed over' the program's 
foCir components. -^--^ 

. It IS noted that 'rate' of soLicitin'g is a measure 
of the n'umber of solicits made by the subject per five minute 

observation segment and says nothing about the quality, 

1 ' 

addressee or topic of the soliciting. 



Program-wide : On. prbgrarri-wide basis,* there is more 

/ 

time spent in soliciting than in not soliciting; 58^ vs. 42%. 
However, the segments with a lower rate of soliciting (1-3) 
exceed those with a moderate rate (4-6) which in turn exceed^ 
those with a high rate (7+) . The percentages are respectively, 
37%, 12% and 10%. Thus the modal rate for SETH students is 
between one and three solicits every five minutes. 

The picture for responding is important in that it 
shows less responding than soliciting the^e are more 
segments with no responses than chere are with no solicits 
and fewer of the segments have moderate or high rates of 
responses than have moderate or high rates of solicits. 



Intra-program differences : The environmental science 

setting of the 'four components of the program are most 

conducive to soliciting. Table shows that the environmental 

science settings contain the lowest proportion of segments 

with no soliciting and the highest proportion of segments 

with higher rates of soliciting. Both the environmental 

science project component and the environmental science 

classes have higher rate's of soliciting \at the 4-6 rate 

\ 

than the general education classes. it seems t?hat the 
environmental science curriculum Itaught in both the 
traditional recitation format and rrv the more experiential 
format of the projects are activating relatively high -rates 
of soliciting . 



- 40 - 



What ^properties pf the SETH settings were associated 
with subjects' greater involvement, higher levels of people 
data and things functioning,, and more frequent soliciting? 
Answer to ^his question would clearly be useful for. the 
design and modification of environmental education program's 
They would further understanding of experiential education 
more generally. 

It must be stated again that the^data does not;" 
readily lend itself to tests of significance. At the same 
time, it has been examined cautiously. Relationships, for 
example between subjects' data functioning and the level 
of activity of staff, will be presented here as stronger 
when they have been found to be associated in a given 
direction across classes, projects, and placements alike. 
Where a relationship is. not as clearcut as this, but a 
meaningful pattern can still be discerned, it will be 
presented as such. 



GENERAL ^^[JM MARY O P AigALYSTS OP CONDITIONS 

7^0CI7v^lTD"^-7ITTr iII(:nEirTEVr^^ 

^ \ 

^ The simplest, most gisnerai conclusion ^is that o 
subjects functioned at their highest levels when staff 
alternated between didactic and enactive roles, in 
supervising, or engaging sjtudents co-operatively in', 
operational tasks. These optimal staff roles were open 
to subjects' -soliciting, and were adapted to students' 
competencies and knowledge. This was reflected in the 
overlap between staff and student people, data, and things " 
functioning, in the medium intensity of staff activity and 
'the joint initiation that characterized the highest levels 
of both soliciting and functioning, and in the association 
of students' soliciting with "partially related talk," 

/ talk that was a^n accommodation between the m^in goal 
of ^n activity and students' information and interests. 

The obverse of this is that students too played a 
part in producing higher levels of functioning, by their 
making the accommodations that resulted in partially .related 
talk, and by their verbal soliciting, especially in the 
plac.ements where staff might have been less likely, at least • 
in their official roles, to exploit the learning opportunities 
for the students. 

Things were indeed .present more ia projects and place-^ 
ments than in classrooms, but their presence did not have 
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consistent relationships with subjects' soliciting or 
data functioning. Students* familiarity with these ^ — 
things or with the results they produced varied between 
projo^... placements, with variations in soliciting and 

data functioniT\g accordingly. Things did enter into a 
larger pattern : the importance of operatives — people, 
data, or things that could be functioned with. to yield 
meaningful results, or results with feedback — jrin sustaining 
student^' ^tivity during --time intervals when staff were 
not present to supervise, or respond to students. « The combina- 
tion of medium intensity staff activity and the presence 
of operative^bccurred most often in projects, and suggests 
an interpretation for. the particularly high levels of 

V 

student performance observed in projects, the intersect 
between formal and /informal education that was diagramed 
in the' first section o£ this report. It must be stressed, 
however, that ^ this optimal combination was observed at 
times in the classes as well, and most of the time that' 
staff were^ present in the placements. 

Not only were physical objects used almost as 
much in projects as in placements, but talk continuousness ' 
in projects was intermediate between classes and placements. 
This conforms further to the expectation that projects 
would combine the properties of formal and non-formafset- 
tings.' A question is raised, however, by the fact that 
the goal of talk was categorized as "theoretical" for the 

V 
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solfc proportion of time, 23:, i.n the pro^Gcts and placG- 
monts, while it was -thoorGtical Ahl of the tin.e in classes. 
Should not projects have been intermediate between classes 
and placements in this important respect, i.e. , 'would not 
teachers (the project staff) have capitalized on the 
theoretical implications of the tasks more often than 
hospital staff? 

Of course, -since talk continuousness was pnsiderably 
higher ^n projects than in placements, the actual amount 6f 
theoretical talk was proportionally higher. Another side 
■to the question, however, is that theoretical talk may have 
oc(:urred.more often_ in the students' placements than the 
concept o^. non-formal had led these investigators to expect." ■ 
Perhaps especially because Mount Sipai is a teaching hospital, 
there were frequently theoretical discussions among s'^taff 
in the presence of students/ for ej^mple when a superv^ising 
dental surgeon discussed with a deritise in training an opera- 
tion in which a SETH subject was assisting. Further,' on 
several occasions the_ observers noticed hospital staff' 
stepping up the teaching role aft^^^^the first 10 minutes or 
so of an observafcioa, or during a lufl in the activities of 
the placement. This suggested an unintended effect: of \he 
observation procedure, the communication to hospital staff, 
that they were now- accountable for both their medical prac- 
tice and the students' e'ducation. This was, however,' a 
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matter of degree rather t\^n ol" kind. There were various 

evidences that most^of the placements had beeit carefully 

select^^and managed to be optin^ally productive for students. 

Again, the students' own questioning, together with staff's 

openness. to it, contributed to tl^e placements' educational 

value. Finally, a few placements actually created tasks 

for the students, for example-, learning to recognize different 

bacteria with an electronic microscope, rather than relegate 

the students to assignments that we^e too passive, repeti,;ferrve7-^ 

or undemanding. / 

The major issue in placement ~- indeed, seems to be 

the p oten tial conflict betv/een accountability to the students 
• 

and accountability to the unit ' s standards . In the clear 
majority of cases observed at Mount Sinai, a ggod accofnmoda- . 
tion appeared to have been reached. There were some cases, 
however, wher^ the match seemed le^s than s^atisfactory . In 
x-ray, for example, a subject spent most of the time during 
the obse^rvation following ^ the technician around, watching , 
the technician's positioning the patients and operating the 
machine, later listening to stdff discussion's of x-rays as 
they were posted, but only being ^asked, or allowed, to- in'Sert 
the plates in a developing cabinet and later remove, them for 
posting (technicians inside the cabinet did the actual . 
developing) . It seemed-^to the^ob*servers that either the 
assignment should be designed to incorporate, the subject , 
more in the unit ' s. activities , or, if this could not be done 
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without compromisiny Lhe staivinrds of the unit, then a 

different placement should be found. The sub3ect, however, 

reported that he learned much :ust from observing in this 

placement, and in fact was influenced by it to choose an 

.X.-ray technician's career. Would it have been still mors 

valuable if, like most of the placements, knd like. the 

projects, the x-ray placement had beerr" more of a hands-on 

experience? The question is unanswerable without a more . 

extensi,ve, especially a longitudianal , study. All of the 

basic indices in the present study, however — involverr.ent , 

levels of people, data and tha,ngs functioning, and soliciting — 

point to the. value of combining the didactic and 'the active 

e.xperiential coniponents of the 'learning environment. At 

the least, 'it can be asseVted that the projects, and in 

most cases the placements, promoted the, behaviors that the 

SETH Environmental Health Program stipulated would evidence 

students' involvement in situations where health problems 

were being dealt with, and their developing entry level 

skills for medical and environmental health careers. A 

larger possibility, which further research will have to ■ 

pursue_, is that SETH enhanced the general quality of its 

students education, especially their loarning about learning, 

throuajt the interplay of its formal and non-formal settings. 

\ 
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INTL'RVILWS WITH r'TUDRNTS 

4 

The evaluation unit postulated that a student's 
perception of his environment would have a bearing on the 
subDect's behavior and learning in each matting of the 
environment. It was decided that the most flexible and 
valid means of obtaining information about student percep- 
tion of the environment would be to conduct a structured 
interview wi.th.each student. Therefore, an interview 
prfitocol was developed in which the ma^or focus was to 
irivestigate how subjects perceived learning to bs" faciii-' 
tated in the general education and environmental health 
cla^sses, the projects and the placements and how students 
viewed their own behavior in each setting. The interview 
protocol was based on some of the primary variable^ in' 
the' SB I and VBI; specifically subject perception of 'his' 
own data, thing^ and people functions and his own initiating 
and 'Soliciting behavior in each setting. Subjects were 
also asked to evaluate the SETH Program's experiential', 
approach to education and to discuss the influence of the 
program on their formation of career goals. Furthermore 
the interview focused on student perception of the entry, 
level skills they would need and SETH's role in helping 
stu(fents acquire entry level skills. The tape-recorded 
interviews averaged approximately 30 minutes in'leTigth 
and were conducted by members of the evaluation unit at 
the end of the evaluation period. 



Interviews with subjects provided the evaluation unit 
w4th student evaluations- of their learning environments and 
'with a context in which to interpret observation data. The ' 
self-report data provided by the structured interview enriched 
and often substantiated the observation data*. 

^ The evaluation unit found that students were intepsted^ 
in discussing their learning environments and appeared to 
enjoy the opportunity to consider educational issues which 
they had not previously considered. One conclusion which' 
can be-drawn from the interviews "is that educational program^ 
should provide students with more opportunities to discuss 
their own educational experiences and their perceptions of 
the educational process. 

-Another discovery made from the interviews was that 
students apply different criteria in evaluating classroo^a^ . 
settings than they do in evaluating work settings, "in the ; 
work setting subjects favored an experiential, activity- ' 
oriented, non-formal approach to leaning. In the classroom ^ 
subjects preferred a more traditional, teachej-djirected , * ' 
formal approach. -The evalS^cion unit woHld suggest that 
opening a jiialogue with 'students about the educational 
process, particular attention .be drawn ta the relationship 
bef^en formal and non-formal education and the value of 
each. Through -such a dialogue students might become more 
tolerant of non-traditional approaches, might view their 
educations in a larger context, and would hopefully become 
more -active participants in their own 'education.-. 

» 
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THE OBSERVATION INSTRUMENT 

♦ 

The Setting Behavior- InventolrY (SBI) and Verbal 
Behavior Observation Instrument (VBOI) have produced 
descriptive data that appear to differentiate 'fche more 
formal and nonformal aspects of the S^TH program, and 
to suggest; impo^rtant interrelationships among the settinc 
variables and students' performance. The SBI and VBOI 
can be modified and condensed- "bi^nges in the specific 
categories of observation are recommended in the Final 
Report. What follows is a brief commentary on the 
observation procedure. 

The evaluation unit has concluded that it must turn 
to a more convention-al event sampling technique, rather 
than l^llowing individual students for lengths of time 
that result^ in interdependent observations, ^!he investi- 
;gators' unfamiliarity with the hospital placements 
particularly led to the perception of a .need in the year 
past to"*follow an individual s^ubject through the entire 
course of a morning in a placement, anticipating that 
activity might be very 'different between different 
phases of the morning. In the main, this turned out not 
to be the case. If 'there was a slowdown of activity 
in some placement settings toward the end of the morning, 
this would be represented just as well in randomly 
distributed samples of briefer time spans as in the longe 
observations. What was not observed was a developmental 
sequence of time phases that might be violated by' briefier 
observations. Routines tended to recur throughout the 
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duration of a project or placement session, the major 
exception being when a project group moved from one 
location- to another, say from inside to outside. 

Of. course, the more experient^i^ settings 
especially can show continual chaage in their . properties 
at certain levels of ' description , as, for example, indiv 
duals enter and leave a setting, yhe proposed strategy 
reflects some progress with, but not a complete solution 
of, this problem. 

It is ^ recommended that the next observations 
focus on 'a given subject for a 15 minute interval, then 
shift to another subject in another setting; for 15 
minutes, then to a third for 15 minutes, and so on; 
Between eight and twelve observations would be collected 
•by a single observer over the course of a day, pre/uming 
that .the different settings to be observed in were, as-al 
Mount Sinai, in close enough proximity to allow this 
shifting. The dat-a collected during a given 15 minute 
interval would be treated as a single observation, i.e., 
behavior counts would be Summarized, j udgments ' as to 
highest level of functioning^would be^made just once, etc 

During the first five minutes of ari observation 
the observer would note the relatively fixed features of 
l^e setting: data, time, concern, location, things and 
data sources in use, people in the setting, and inter- 
action fqrmat. During the middle five minutes, verbal 
interaction' among the participants would be recorded 
and characterized. The last five minutes would be used 
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to make summary judgments about the highest levels 
of things, da-ta, and people functioning observed from ^ 
the beginning of the observation, together with 
judgment'^ about the activity levels of the different 
-participants in relation to the subject and how the 
initiation of activity was shared. 

If the observer's initial perceptions of the 
relatively fixed features were modified after the first 
five minutes, for example a staff member entered and 
the interaction format was subsequently perceived to be 
a supervised task instead of an unsupervised task, changes 
in the record could be made accordingly. , The summary 
judgments at the end would take this into account, for ^ 
example in recording^taf f ' s being' active in relation 
to the subject for less than the full time, if, however, ' 
a whole constellation of setting properties changed, for 
example in a recitation endi^^and sea1:work beginning, 
the observation to that point would be scratched and a 
^resh observation of the^same subject would Commence, 
Just where ^ to draw the line for these decisions betwd'en 
changes within a setting and changes of a setting will 
.have to be worked out in the first trials of the revised 
procedure. The 15 minute observation ii^terval considerably 
reduces, the likelihood of this, compa^red with the longer 
intervals used^ this year. 

Some variable's from the ^instruments would be retained 
in their present form, some would jDe revised, -and sofne* 

9 

would be eliminated, . 0 • 




The proposed changes represent an agenda for the 
initial work of a team that carries on the work of th( 
present evaluation unit. ''The instrument that would ^ 
emerge from this has considerable promise for the 
study of 'contrasting educational settings ^ formal 
and nonformal, academic and experiential, or school a 
work, as these might variously be identified. 
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